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PREFACE 


The  work  described  in  this  publication  was  performed  by  the 
Mathematical  Analysis  Research  Corporation  (MARC)  under  contract  to 
the  Jet  Propulsion  Laboratory,  an  operating  division  of  the  California 
Institute  of  Technology.  This  activity  is  sponsored  by  the  Jet 
Propulsion  Laboratory  under  contract  NAS7-918,  RE182,  A187  with  the 
National  Aeronautics  and  Space  Administration,  for  the  United  States 
Army  Intelligence  Center  and  School. 


This  specific  work  was  performed  in  accordance  with  the  FY-87 
statement  of  work  (SOW  #2). 
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No.  119 


Normalization  Factors  Used  In  Estimating  Variance 


INTRODUCTION 

While  investigating  Quickfix,  two  questions  arose  concerning  the  part  of 
the  code  where  the  estimate  of  variance  is  computed.  (The  estimate  is  only 
used  if  the  estimated  standard  deviation  derived  from  the  variance  is  bigger 
than  3-)  One  question  concerned  the  impact  of  truncation  and  shall  not  be 
discussed  further  here.  The  other  question  concerned  the  division  by  n-3  that 
occurs  in  the  calculation  where  n  is  the  number  of  lines  of  bearing  being 
used.  If  n-3  is  wrong  it  affects  ellipse  size  estimates.  Simple  one  variable 
problems  use  n-1 ,  but  since  there  are  two  coordinates  to  be  determined  one 
might  expect  to  see  n-2.  On  further  reflection,  the  usual  analysis  does  not 
directly  apply  to  fixing  so  an  investigation  seemed  necessary. 

It  turns  out  that  use  of  the  expected  value  of  the  estimator  implies: 
i)  n-2  is  the  correct  term  to  divide  by  for  Minimization  of  Square 
Angular  Error  methods  and  sine  variations  such  as  FFIX.  It  is 
also  the  correct  term  for  Weighted  Perpendicular, 
ii)  n-2  only  applies  to  the  Perpendicular  Method  in  the  case  where 
all  sensors  are  approximately  the  same  distance  from  the  target. 

In  other  cases  this  estimator  Is  unstable  but  probably  conservative. 

As  an  example,  suppose  one  sensor  is  very  close  to  the  emitter 
in  comparison  with  the  other  sensors.  Then 

a)  the  close  sensor  doesn't  influence  the  point  estimate  much 

b)  however,  with  a  close  sensor  any  size  measured  (not  real) 
angular  error  is  possible.  If  sensors  are  close  enough  estimates 
could  even  violate  common  sense  since  close  sensors  are  nearly 
ignored.  The  result  is  that  division  by  n-2  is  conservative  and 
error  ellipses  would  be  larger  than  necessary  at  least  with  regard 
to  this  one  issue. 

Applicability  of  F  statistics  and  tail  behavior  is  more  aifficuii.  to  analyze 
and  not  done  here.  At  the  very  least  a  closer  look  is  merited.  Analysis  of 
the  behavior  of  the  variance  estimator  alone  does  not  give  a  complete  picture. 

On  the  next  page  a  few  examples  are  given.  The  analysis  for  the  different 
methods  follows  in  the  rest  of  the  report. 


I.  EXAMPLES 


All  methods  were  computed  but  only  Perpendicular  is  listed  as  other 
methods  all  yielded  n-2  (where  n  is  the  number  of  points)  as  expected. 


Put  the  Emitter  on  the  y-axis  at  (0,20)  and  the  sensors  ... 


SENSOR  LOCATIONS 

n-2 

Perpendicular  Method 

on  the  x-axis  at  (-20,0),  (0,0),  and  (20,0) 

1 

1.125 

on  the  x-axis  at  (0,0),  (20,0),  and  (40,0) 

1 

1  .286 

on  the  x-axis  at  (0,0),  (40,0),  and  (80,0) 

1 

1  .620 

i 

on  the  x-axis  at  (0,0),  (20,0)  and  (400,0) 

1 

13*323 

equidistant  from 

the  emitter  at  (0,0),  (12,4),  and  ( 1 6 , 8 ) 

1 

1  .000 

on  the  x-axis  at  (-20,0) , (-16,0) , (-12,0) , 

(-8,0), (-4,0), (0,0), (4,0), 

(8,0), (12,0), (16,0), 

1 

and  (20,0) 

9 

9.095 

on  the  x-axis  at  (-40,0) , (-32,0) , (-24,0) , 

(-16,0), (-8,0), (0,0), (8,0), 

(16,0), (24,0), (32,0), 

and  (40,0) 

9 

9.492 

This  means  for  example  that  in  the  (0,0) , (20,0) ,  and  (400,0)  case  one  should 
divide  the  statistic  for  variance  by  13-323  whereas  in  fact  it  is  divided  by 
1.  Hence  the  resulting  error  ellipse  estimate  would  be  too  large  from  this 
point  of  view  by  a  factor  of  13.323  for  area  or  the  square  root  of  13*323  too 
lsrg  in  each  direction. 


II.  EXPECTED  VALUE  OF  THE  UNNORMALIZED  ANGULAR  VARIANCE  ESTIMATOR  STATISTIC 


Definitions 


(X,Y)  -  true  location  of  the  emitter 
8k(X,Y)  -  true  bearing  from  the  kth  sensor  to  the  emitter  (X,Y) 

A 

6k  -  observed  bearing  from  the  kth  sensor  (multiple  readings 
are  treated  as  coming  from  different  sensors) 

A  A  A  A 

(x,y)  -  (x(e  ,...,6  ),y(e1f...,e  ))«estimated  location  of  the 
1  1  n  emitter 

6k(x,y)  -  bearing  from  the  kth  sensor  to  the  estimate  (x,y) 

o  -  standard  deviation  of  the  angular  measurement  of  the 
LOBs  in  radians  (multiply  by  tt/180  if  in  degrees) 

A 

eR  -  error  in  kth  LOB  -  0k-0k(X,Y)  (assume  independent  ek) 
(xktyk)*  sensor  location  of  kth  LOB 


rk  “  <x~V2+(y~yk>2  Rk»(X-xk)2*(Y-yk)2 


Calculations 


The  following  approximation  will  be  the  basis  for  subsequent  calculations 

ek(x,y)-ek  ~[ek<x,Y)+  r^(  ^6k(x,y)  ♦  *6k(x'y)  )e1>[ek(X,Y>+ek] 

ax  dej  5y  ^ 

where  all  of  the  partial  derivatives  indicated  must  be  evaluated  at  the  true 
point  or  zero  error.  (Note  that  this  approximation  is  based  upon  a  Taylor 
Series  expansion.)  To  evaluate  this  expression  one  also  needs  to  recall  that 


6k(x,y)  -  Arctan( (x-xk)/(y-yk)) 
and  hence 

a  ek(x,y)  „  (y-y  )/r2 
3x  K 

d  ek(x,y)  _  -(x-x.  )/r2 

^y 

Substituting,  evaluating  at  the  true  and  simplifying  one  gets 
ek(x,y)-0k  r*  [jZj( (Y-yk)  £x  -(X-XR) a  y  )ej]/Rk-[ek] 


And  hence 


E(kZ?(6k(x,y)-£k)2)  ^  kl"[  z"{((Y-yk)  -(X-xR)  djr  ))2o2/rJ  ] 

3gj  aeJ 

-  2kZ^C  ( ( Y~yk)  i*  ~(X-xk)4l  )  ]o2/R2+  no2 


III.  LEAST  SQUARES  TYPE  FIX  METHODS 


Part  of  the  analyis  of  these  methods  is  independent  of  which  method  is 
being  analyzed. 

Extra  definitions  that  apply  to  Least  Square  based  methods 

Lk  -  Lk(x,y, 6k)-the  'squared  error  term*  corresponding  to 

the  kth  LOB  and  a  location  estimate  of  (x,y) 
for  the  least  square  method. 

L(x,y , 8^ , . . . , 6  )  -  ^zl^-the  sum  of  squares  that  the  method  minimizes 
Let  bk-^Lk/dx  ck-3Lk/«Jy  d^L^x*  e^^/dx^y  f^’L^y* 

where  each  term  above  is  evaluated  at  the  true  angles  and  point. 

Let  notation  represent  derivatives  with  respect  to  6.  for  b  and  c. . 

Let  Q-1/(Zd.Zfi-reiIe1). 

These  include  the  Perpendicular  method,  minimization  of  angular  error, 
and  the  sine  variation  of  minimization  of  angular  error  used  by  FFIX 

Assume  that  x,y  are  defined  implicitly  as  the  minimum  of 

L-Z  Lk(x,y,ek) 

in  the  sense  that  dL/dx-dL/iy-O 

One  car.  show  (as  MARC  has  In  it's  report  "Two  Dimensional  Uncorrelated 
Bias  in  Fix  Algorithms")  that  the  partial  derivatives  evaluated  at  the  true 
are 


^x/d  eA 

-1 

£fk 

0) 

1 

? 

bi 

by/dt. 

L  l  J 

(Zdk)(Zfk)-(Zek)2 

*v 

t 

rt 

m  - 

The  value  of  the  first  partials  of  x  and  y  for  different  Least  Square  based 
methods  and  derivations  of  the  correct  value  term  to  divide  by  are  listed  in 
the  the  first  portion  of  the  Appendix. 


i: 


Demonstration  that  n-2  applies  to  Minimization  of  Square  Angular  Error 


For  this  method,  (bi)2-2di,  (c^-2^,  and  b^cj^e^ 


Q2  jZ"{((Y-yk)  l*  -(X-xR)  )}2  - 


“  jl"  C{(Y-yk)lfi+(X-xk)Iei}bj-{(Y-yk)re1^(X-xk)rdl)c’]J 


-  {{(Y-yk)Zfi+(X-xk)Iei}2JI1  (b^)2 

-  2{(Y-yk)Zf.>(X-xk)Iei){(Y-yk)Ze1-(X-xk)rdi}Jz!|,bjc’ 

♦  {(Y-yk)Ze.+(X-xk)Zdi}2  jZ^cj)2 

-  {(Y-yk)Zf1+(X-xk)Ze. }2JZ12dj 

-  2{(Y-yk)Zfi+(X-xk)Ze.}{(Y-yk)Ze1+(X-xk)Zdi}Jz"2eJ 

*  {(Y-yk)Zei^(X-xk)Zd.}2  ^2T ^ 

-  [{(Y-yk)Zfi}2+2(Y-yk)(X-xk)Ze.Zf.}*{(X-xk)Ze.}2]Jz!j12dj 

-  2[(Y-yk)2ZfiZe.>(X-xk)(Y-yk){(Zei)2*ZdiZfi}  +  (X-xk)2ZdiZe1]JZr|12eJ 
+  [{(Y-yk)Zei}2>2(Y-yk)(X-xk)ZdiZe.}  +  {(X-xk)Zdi}2]Jz!|12fj 

-  (Y-yk)2{2ZfiZf1Zd.-2Zf1ZeiZe1} 

+(X-xk)(Y-yk) {HZd.ZeiZfi-4ZeiZeiZei) 
^(X-xk)2l-2ZekZekZdk+2ZdkZdkZfk} 

However  since  Q  factors  out  of  the  last  expression  one  has 

,l"H(Y-yk)  £x  -(X-y.k)  ))2-  2[(Y-yk)2£r1*2(X-xk)(Y-yk)IcJ*(X-xk)2Idi:/Q 

"  Jcj  jEj 


Hence 


|i  -«-xk)  >jV/rJ]  -  t  Ikdk  i1f1-2iekiei*ikfkilai]  =  VQ 


-  2Qo  2/Q 

-  2o2 


The  other  term 

kl"{ C (Y-yk)  ^x  -(X-xk)  )}o2/R2 


-kI^((Y-yk)iri.(X-xk)Ie1)b'-t(Y-,k)xei*<X-xk)Id1)c;]a2/R2 


*  -C-iVVi€ktViekiV£rki<ik]o2/Q 

E(kZ1J1(ek(x,y)-ek)2)  ~  2o2-2(2o2)*no2-(n-2)o2 


Weighted  Perpendicular  (Not  Definable  in  Terms  of  Least  Squares) 


The  Weighted  Perpendicular  Method  is  not  definable  as  a  least  square*, 
method  and  so  a  separate  formula  needs  to  be  derived  for  first-order  bias, 
is  necessary  to  establish  notation  for  this  case. 

Definitions 


a 

•H 

ft) 

cosJei 

Ai  “ 

cosaei(X,Y)-(Y-yi)a/Ra 

a 

-  la^r2 

A  -  EAj/R 

bi  “ 

sin28^ 

Bi  " 

sinaei(X,Y)-(X-xi)2/Ra 

b 

■  rbi/ri 

B  -  EB  /R 

ci  ‘ 

sin8^cosei 

Ci-(X-xi)(y-y1)/Ra 

c 

-  Ec^/r2 

C  -  EC^/R 

d  .  - 
l 

aixi  “ 

ciyi 

D.  -  A1x1  - 

d 

-  Idi/r2 

D  -  ID1/R 

Ci  “ 

“cixi  + 

biyi 

E1  ‘  'Vl  *  Vl 

e 

“  Iei/ri 

E  -  EE./R 

l 

Isi/ri 


(x,y)  -  (Zsi/rp  1  (Is./r2  1  ) 


b  c 


c  a 


First  Partials: 

^ri/<iek  "  2(x-xi)Wx/^0k)  +  2(y-yi)  (^y/^0k) 

^a/^ek  -  -2ck/r^  -  Z(a./r“> 

Sb/aek-  2ck/rJ  -  Kbj/rS  >rj/j6k) 

*c/aSk  -  Uk-bk)/rJ  -  Kc^rJ. 

*a/<5ek  -  C-2=kxk  *  (bk-ak)yk:/rj  -  Kdj/rJ-  5>r;/aSk) 

ie/K  -  C(wv  2vk]/r;  -  «vrr 


Differentiating  the  defining  equation: 


^  x/^ej 
^y/^e 


(a(^b/^8)*b(ia/^6u)-2c(^c/^6)) 
(ab  -  c2)2  *  K 


bd  +  ce 
cd  +  ae 


i  iQd/^ek')  d(£>b/£ek)  ♦  c(de/^ek)  +  e&c/^ek) 

(ab  -  c2)  c(*d/&e  )  ♦  d(fcc/Ae  )  ♦  a(^e/de,  )  ♦  e(£a/£e  ) 


Simplifying  the  defining  equation: 


Let  fk»  2[b2d+bce-ace-c2d]ck  ♦  [2cbd+c2e+abe](ak-bk) 

♦  Cb2a-c*b](-2ckxk  +  <bk"ak>yk>  +  [c(ab-c2 ) ]( (bR-ak)xk  ♦  2ckyk> 
hk«  [-b1d-bce]ak+[-ace-csd]bk+[2cbd+c2e+abe]ck+[b*a-cab]dk+[c(ab-c*) ]e 

Let  gk»  2[bcd+c2e-acd-a2e]ck  +  [2ace+c2d+abd](ak-bk) 

+  [c(ab-c2)](-2ekxk  +  (bk“ak)yk)  +  [a(ab-c2 ) ]( (bk~ak)xk  +  2cRyk> 
ik-  [-bcd-c2e]ak+[-acd-a2e]bk+[2ace+c2d+abd]Ck+[ (ab-c2)c]dk+[a(ab-c2)]e 

^  x/^ek  -  { fR/r2  -  I  1/r^Orj/^6k*  hj  }/(ab-c2)2 

^y/^ek  -  ^Sk/rk  *  1  l/r^Or2/^ek*  i^  }/(ab-c2)2 

Let  Fk*Gk«Hk>  and  I  be  fk>8k«hki  and  ik  evaluted  at  the  true  as  in  the 
Taylor  Series  expansion. 

A  A 

Plugging  in  for  ^r2/^0k  and  evaluating  at  the  true  yields 

^x/^6k  -  {FR/R2  -jI^12{((X-xj)^x/^ek  +  (Y-yj)^y/^Bk)Hj/Rj}/(AB-C2)2 
3y/^ek  «  lGk/R2  -jI^2{((X-xJ)ax/dek^(Y-yj)^y/S0k)Ij/Rj}/(AB-C2)2 
where  the  partials  shown  are  also  evaluated  at  the  true. 

Let 

q  -  [(AB-C2)2+2  z"{(X-x.)H./R1J}][(AB-C2)2+2  { ( Y-y  )I  /R^ }  ] 

I  J  J  J  J* '  J  J  J 

For  partials  evaluated  at  the  true 

^  x/^0k  «  [Fk/R2{(AB-C2)2+jZ^2{((Y-yJ)IJ/Rj}-Gk/R^{jl!|,2(Y-yj)Hj/R^}]/q 

Sy/<50k  “C-Fk/Rk{Jl"2{((X-xj)Ij/R^Gk/R^{(AB-C2)2+jr!|12(X-xj)HJ/Rj}3/q 

The  answer  must  be  invariant  under  translations  (independent  of  where  the 
origin  is  placed.)  Fortunately  calculations  are  a  good  deal  easier  if  we 
choose  (X,Y)-(0,0).  (Note  we  don't  do  that  in  the  computerized  examples 
however.)  With  this  assumption 

Dk«Ek-0  for  all  k.  Hence  D-E-0.  Further  implying  Hk-Ik-0  for  all  k. 
Hence  q«(A8-C2)^  and 

^x/iek-(AB-C2)2Fk/(R2q).{B(-2Ckxk^(Bk-Ak)yk)*C((Bk-Ak)xk*2Ckyk))/[Rk(AB-C2)] 


-  {B(-(Bk^Ak)yk)+C((Bk^Ak)xk}/[R2(AB-C2)] 

-  {-Byk+Cxk)/[R2(AB-C2)] 

^y/^ek-(AB-C2)2Gk/(R2q)-{C(-2Ckxk^(Bk-Ak)yk)^A((Bk-Ak)xk^2Ckyk)}/:R2(AB-C2)] 

-  l-Cyk*Axk}/[R2(AB-C2)] 

{(Y-yk)5x/^eJ-(x-xk)iy/dej)-  -y^x/dOj+x^y/aOj 

-  {By2-2Cxkyk*Ax2}/[R2(AB-C2)] 
kr^{(Y-yk)3x/S6k-(X-xk)dy/^ek}/R2  -  {BA-2C2+AB}/(AB-C2)-2 

jS?  kr"{(Y-yk)^x/^0J-(X-xk)^y/aej}2/R|J 

"  jl?  kl"{yk«x/5ej)2-2xkykQx/d0j)(iy/d6J)+x2(dy/^ej)2}/RjJ 

-  i"  {A(dx/a0.)2-2cax/^e  )(dy/^6  )+B(dy/A6  )2} 

J*  J  J  J  J 

-  Jl"[A{-By>CxJ}2-2C{-Byj+CxjH-Cyj+Axj}+B{-Cyj+AxJ}2]/[R2(AB-C2)]2 
-[A(B2A-2BCC+C2B}-2C{BCA-BAC-CCC^CAB}+B{C2A-2CAC+A2B}]/(AB-C2)2 
«[AB{AB-C2}-2C2{BA-C2}+AB{-C2+AB}]/(AB-C2)2 

-2 

Thus 

E(kl"(ek(x>y)-ek)2)  /w  2o2-2(2o2)+no2  -  (n-2)o2 

(Note  that  partials  with  respect  to  9  are  equal  to  partials  with  respect 
toek.) 


